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ABSTRACT 


A communications system composed of n transmitters and r receivers and 
which is subject to failure is modeled as a semi-Markov process having four 
States. Transient and steady state results are analyzed to determine the 
probability that the system is in any given state. Two examples are given 


to illustrate the results in the transient as well as in the steady state. 
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Lt. (NE RODUCTION 


A communications system is analyzed which has n transmitters and r re- 
ceivers (r <n). Each transmitter works in cycles of transmission and idle 
periods of time, which are random. Each of the receivers is only capable 
of handling one message at the time, and therefore, messages transmitted 
while all r receivers are busy are then lost. 

Transmitters are subject to failure during transmission and idle periods, 
and when this occurs, it takes a random amount of time to be repaired and 
put back in service. 

The purpose of this paper is to describe a mathematical model for the 
system and analyze the transient and steady state results in order to de- 
termine the probability of a given message being lost. 

The paper is written in four parts. In Part Ii a model of a Semi-Markov 
process is formulated and its variables and properties defined. Part III 


contains the transient results, and Part IV the steady state results. 


a 





hie MODEL FORMULATION 


Given that the n transmitters composing the system have the same char- 
acteristics and work under the same conditions, the probability that any 
of them is transmitting at some arbitrary point in time is essentially the 
same. 

Suppose there are only r receivers, each of which can receive only one 
message at the time. Then if L(t) is the probability that a message trans- 


mitted at t is lost, 


L(t) = p [(r+1) or more messages are being transmitted at t] 
n 
n k k 
= Joce SS eo eee 
: k 
k=r+l 


where p(t) is the probability an individual message is being transmitted 
ate €. 

Our problem is to determine p(t). Consider a system where a transmitter 
transmits for some fixed time @ , and is idle (not transmitting) for some 
fixed time B . Also assume the transmitter never fails and that we measure 


time zero from the start of a new transmission time. Then, 


p(t) 1 n(at+B)s ts n(atB) ta, n= 0,1,2,... 


O otherwise. 
This is illustrated in figure l. 





p (t) 


x od QQ) 28428 +s. 
Figure 1. A simple example for v(t). 


In our model we consider the transmission and idle times as random 
variables. Also we include the possibility of transmitter failure both 
while transmitting and while idling. We assume that if it fails, it takes 
a random repair time to fix, at which point it starts over a new transmit 
or idle time, depending on its state at time of failure. Thus the system 


can be in one of four states: 


State Description 
0 Transmitting 
aI : Idle and up 
2 On repair (failure occurred 


during tranmission) 


3 On repair (failure occurred 
during idle period) 


Let T, be the length of the jth transmission, tT, } init.d, vandom vari. 
ables with distribution function (d.f.) T(t). Thus T(t) = P(T, ¢ eae 


Pere... . Also lét ie eberehe Lene ehisot  ehe ith idle time, eS Baan terra [he 


random variables with d.f. I(t). If the system is operating (either 





transmitting or idle) we assume an exponential time to failure with rate A 
(mean time to failure is 1/4). Once failed, the time to repair is also 
assumed to be exponential at rate je (mean repair time I/) independent of 
whether the transmitter was idle or transmitting. 

Thus the transmitter follows a stochastic process which makes transi- 
tions according to a Markov Chain when viewed at points at which it changes 
state. It is crucial that times to failure be exponential for the Markov 
property to hold. For example, if the transmitter makes a transition from 
idje to transmit (state 1 to state 0), then if the distribution of time to 
the next transition is to be independent of all previous history of the 
process, the knowledge of when the system last failed andwas repaired must 
be irrelevant. This can only be true with exponential times to failure. 

It is not important in the model that the repair times be exponential. 

The amount of time spent in each state before a transition occurs is 
random. Defining Z(t) ={state of the process at time t] ; then the stochas- 
tic process {z(t), t.2 0} is a Semi-Markov Process, and p(t) = p[Z(t) = o] . 


We now define: 


process next makes a transition process has 
Qi 5 ft) = P | into state j and this occurs just entered (2) 
in a timeét au 
4) = P [ state at time t is j process started 
in=etate iat (3) 
time 0 
= Pp [ 2¢e) =; | 20) | 
process has just 
Fy (t) = —— will occur entered i and (4) 
in an amount of time ~ t will next enter 


H, . (t) = P | next transition occurs process has 
; in an amount of time €t just entered (3) 
1 


P 


iq = Q,,6°? = Pj} next transition will process just (6) 
be into state j entered i 


Since Qi 4 t) is the joint probability that the next transition is from i to 


j and in time less than t, we have 


Fi (r= By) when Py 7 0, (7) 


icy 


and thus 


3 3 
Hw > PYFFM => AYH. w 
J *? Jj=0 


It can be shown (Ross [1!) that 
3 t 
Pj (+) = Sij [} - H; (4)] + > [R (t-x) dQ,, (*) ) (9) 
£0 4 


where 7, is the Kroneker delta. 


If we let H, (t) =] - H, (t) and Vi * Phy (t) indicate the convolution 
in (9), we obtain 


3 


R, () = Jj H® + ) int P(t) , t,j71,%3. WO) 


KrO 





This expression can also be written in matrix form as 
fP(t) = Hi + Bell) 


where Jy (t) is a diagonal matrix of H; (t) and gx £6) is the matrix 


. tah 


convolution with ij element 


t 


[ge PO], - ) [x (t-x> LQ: WD. 


We can also define 


© 


Bix | te dhe (12) 


as the expected amount of time spent in state i during each visit; and 


Cy | ' “a (13) 


as the expected amount of time spent in i during each visit, given that 
the next state entered is j. 


te follows that 


3 
fei ‘ a Fj; yo, (14) 
Jjzoe 





III. TRANSIENT RESULTS 


We first examine the transient results. In order to do so, we assume 
that the transmission and idle times have general distributions, while fail- 


ure and repair times have exponential distributions. That is 


T = transmission time nN T(t) 
I = idle time mw I(t) 
X = time to failure lad jeer 
R = repair time ~~ 1K 


We first compute F = | Py] so andes ind that 


process just 
entered state 0 


Pol 


Pi next transition will be 
inte State | 





P| failure time> transmission time] 


PY (X>T) c fe dT(x) = t( A). 
@ 


Also 


Li) = Pj} next transition will be 
entered state l 


into state 0 





pRecess just 


P | failure time? transmission time] 


E61) _f cAax dix) = 72). 


where t(Q) and i(A) are the Laplace-Stieljes transforms of the trans- 


mission and idle times distributions evaluated at A , the failure rate. 


Now £ = [ Pss]4s of the following form 


10 





O £(A) 4 os) 0 


v6a) O 1-0 (a) 
P= 
{ 0 O 0) 
O { O O 


We need to find F (t) = | Fa ce) | as defined in (4). 


Now, 


mince. 7< % | 


Fé) = PLT<t[T<X]J = 
@) = Pl J Pirex 


In order to determine the joint probability distribution of X and T 


we condition’ in the value of X. 
P[Tct] if x zt 


eir<t, mx ieee 
Pmincay if net , 


and then t re 
aS 
P[T<t, T<x].= [te 10 ee -[TwAe * dk 
e t 
oan 
= SLT (k) 
" ; 
SO _™ “ 
Pat) = Seat ; 
t (A) 


Following the same procedure we find 


al 





yo 
aoe - f Es ie) 





o2 (t) = = F 
Zz tt £04) 

t 
a) « fe** are) 


(a) 


7 ¢€ 
{-T@e** - ti ea“ nie 
{= CO 


F,, (#) = 


We will now determine OQ (t) = | 045 (8)| by using the relation de- 


mined in (/); i.e., 


Qi; (t) 
Gi (+) -_ eS n 
Fe Pe j 


This gives us 


aol 
Qo, +) - | a whl); 
oO 


c 
ee ieee e* | en 4® aT , 
's) 


"1 


t 
R,, (+) je Alte) , 


re) 


, a 
Ont = 1- tHe. fet AI, 


~ ce 
Gan, (82) Gs, &) = R(t) = {j-eF ; 


) 


Qos (t) = Qi2() ~ Ory (+) = Or (+) = ax (4) = lugs (t) «+: 
vee Qian (4) = Qs, (t) © O. 


By means of the relation (8) we find that 


12 





He) = THe, 
AG) -Tae*, 
H. (+) = R&@), 
A, = RG). 


We now have the necessary elements to compute the relationship stated 


mil); that is, 


Pe) = Hh) + 3*P&) 


to determine ff (t). 


Taking Laplace transforms and rewriting (11) we get 


Po) 2 H, (s) t g (s) Cs) 


mMnich can also be written 


ro =] 


1s [1- 3 ¢s)| (5) 


Now we have that 





0 Eds) =A |b -Fesd| 0 
me Fey O oO ror | !- 7 (a99)| 
(4) = 
r(s) O Oo Oo 
° + (s) ° O 





where, for instance, Igo (s) is determined by 


_ wo to tL mn “ 
Gor(S) = { e** 48, (t) = fe* al l- c T)-[ 6? Tle) 


- f “eo | € aft” or At 


Ny 


Co 60 7 
al. { a Bie ae. J gp wae Tt) kt 
Oo o 


yt =e 
ee ~ A TF (A+s) ; 


where T(A +s) is the Laplace transform of the distribution of transmission 


time, and we know that 


t (A+s) 


TOAts) = ye 


? 


so then 


Goals) = =H—[1- Ecare)] 


In our problem we are only interested in Ge i<e., the probabilemr, 





that a transmitter isinatransmission period at time t. Then we only need 
As oct A ola, 
to determine ere) - But ane) is the (0,0) element of (1-(s) ] Hy (s) 
=! 
Which requires only the (0,0) element of [1-4s) | . Because of the special 
structure of q(s) algebraic inversion to obtain this one element was possi- 


ble. After much algebra the result is 





- 1~ 4 1-Ta+s)] rs) 


(1- 4, [1-taes] eo} (1- 24, [1- Tara] a 











14 





Two examples are given to illustrate the transient results. 


Example 1 
Let transmission time be exponential with mean wx and idle time also ex- 


ponential with mean p a then 


uy 


© ces Met (jes 245+ Ap) s t Qu+¥p+h)s? 
sf pe fee Yp(Arpds [Carp + p40 (fas fos 


ee @¢ 


+s’ 
+(2CAspr+ Ya + fs | 3° + 5° 


This can be written as 


p Ne (54a) (5+ 6) (s4+e) 


es =) 
5 (s+a)(s+f) (54g) : 


where a, b and c must satisfy the relations 


Ze = [e/g ) 


c(atb)+ab = ee 2 pulp 4 A P 
atb+c = Xf + Ye rs ee 


Also d, f£ and g must satisfy 


dfg= Of: + Jt) (A+ p) : 
CT Silage) ou id Cleans. (2u+Aa)(z+ Vu ) , 
d+ftg = 2( Ath) + Yq + ip i 


Then the inverse of the Laplace transform in (15) will be 


Rot) = A+B(1-2)o% + cu-Het, DU- BE , 


15 





where 
Ae abe. 
AP 9 
a-~(o1e\ad+be 
(P- a) (9-H) 
ae f-(b1¢) + be 
— (4-4) (9-#) 
ae 9 - (610) 9 + be 
—  (a-g) (2-9) 


If we let 


? 


B= 


Qs vO See. 
p = 20.0 se. 


/4 = {8C.0 see. 


Vu - 30.0 see. 


then, 


-~,033t ~.034¢ ~. 556% 
Po(t)= .0O78 +.col1e + O13 + 70% e 


Figure 2 illustrates Eee) for different values of t. It can be ob- 
served that for the given parameters values, the system reaches the steady 


state very fast. 


Besides the method just described to take the inverse of Pane 
numerical inversion (LINV IBM-360) was used and yielded the same results 
for yg (t) using different values of t. 

Table I shows L(t), the probability that a message transmitted at time t 


is lost, for different values of t and for n = 30 and r = 3. 





Re Ct) 


4.0 


tosec. 15 S€¢, t 


9 
on 
& 
e 


Micounea 2a es The probabality that a transmitter is 
in a transmission period plotted as a 
fuUmecionot tt. 





ere L(t) 
O sec. iD) 
Des Se ORI, 
Sar O99 
Gene Ong] 
ie cr 0.85 
ne 0.68 
in as 0.49 
Sa OFS 
38 0.30 

JO G725 


Table I. Probability that a message transmitted 
at time © is lost. 
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Example 2 


Let & be the transmission time and p the idle period length, both 
assumed constant, and failure and repair times have exponential distribu- 


tions with parameters vi and /f& respectively. Then 


| (A+ +5) S+ Awe 96] it _e- (A+s)« 


ee eS 
[ (At p4s)s de AF, | [(At pe Ss) s+ Ay | 


eae (445) . 
= (A+) (p48) ew (8) (1+6) 


Using numerical inversion did not give accurate results because of the 
existence of sharp peaks in Pot) due to the constant transmission and 
idle times assumed. Exact inversion in this case was not found to be 


possible. 
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IV. STEADY STATE RESULTS 


We now examine the output of the model after a long period of time; 
that is, in the steady state. 
If we denote by J, the initial state of the process, and for nz1 let 


th transition has 


J, denote the state of the process immediately after the n 
occurred, the process as n = 0,1,2,--} is an embedded Markov Chain with 


transition probabilities P., = Q (eo). Furthermore, if the embedded Markov 


J 1j 


Chain is aperiodic and irreducible, defining 


Pee lim pl2) = 7] £(o=é] 


t-— 


it can be shown (Ross id yr that 


5 shy 
aait -ojmmeal (16) 


ae 
(zo 


where TT; » j = Ohis2,3 are the limiting probabilities for the embedded 
Markov Chain. That Toe be TI mnie T,), then the T's are the solu- 


tions for i ac T-p - is i; tl 


The same examples used to illustrate the transient results will be used 
here. 

On example 1 transmission and idle times have both exponential distri- 
butions with parameters thy and Vg respectively. The matrix fis now given 
by 


ae) 





144A 7 1+4d 
Ti a 
+f + 
a = 
i O O O 


This & matrix is of a chain with period 2 so is not aperiodic. How- 

3 

ever the equations T-T-P ; 2 1, = 1 can still be solved in which case 
J 0 

the T.'s are interpreted to ne the probability of being in a given state 

at an arbitrary time point. If one knew that the time point were an odd 

or even number of periods after the process started then the probability 

of being in a given state would not be given by the To's. However, such 

a Situation is not of interest to us in this paper and the fT, 's are in fact 

the numbers which we want. 


Using this matrix of transition probabilities we arrive at 


_ eed 
D , 


fy -L+fpa , 


= 
6 
' 





tt, a oe 


where )D alt 4 (% + 8) 4]. 
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Recalling that we defined the expected amount of time spent in state i 
during each visit, given that the next state entered is j as 


ij -f t ahi (t) 


2) 
we have 


1 
Car : Yu +r 





1 
% 02 Vg + 2 


qe 
Lio = ip + 2 


ee eee 
13 Yp+ a 


Lao? t., a Vn 
The expected amount of time spent in each of the states in each 
3 
Pasit, US = d- Fea 1. - is 
er J 
a 
oe Weta 4 


- —_ 
Vora 


Ms = Ms = Vy, 


It is possible now to compute ae j = 0,1,2,3 by using the results just 


derived and the relation stated in (16). 


On example 2 we let o& and B be the transmission and idle times re- 


spectively, assumed constant. We also let failure and repair times have 


exponential distributions with parameters A and ie respectively. The ma- 


trix ( = [Ps5| will then be 


74 





O e 1-e O 
e-f4 O e) 1 er hr 
P= 
{ O O O 
@) 4 O O 


Using the same procedure as in example 1, we can find the necessary elements 
to solve for the Pats. 
Table II shows the values of the P.'s, j = 0,1,2,3 computed for exam- 


ples 1 and 2 for X= 2.0, P= 20.0, 1/4 = 180.0 and Lin = 30.0 seconds. 





State j ELObapisities P. 
Example 1. Example 2. 
0 OmOy 77 22Z 0.1109148 
1 O57 792229 0.8888418 
Zz 0.0129867 Q0.0000211 
3 Oi 235079 0.0002221 


Table II. Steady state probabilities for examples 
lL andy? . 


We can now compute L(®), the steady state probability that a message 
is lost, by means of the relation stated in Part II. 
Table III shows the values of L(®) for different values of n andr 


for examples 1 and 2. 
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Example 1. Emanmpie. 2 . 
2 S; 4 3 4 5 





Table III. Steady state probability that a message is lost 
computed for examples 1 and 2. 
The case n = 30 is shown plotted in figure 3 for different values of 
the number of receivers. For both examples we see that the loss probability 
decreases rapidly with an increase in the number of receivers, and for r = 5 


the loss probabilities decrease to .03 and .10 for examples 1 and 2 respec- 


tively. 
Ltr) 
i.0 
bx. 2 
Bx. 1 
Ay n=30 : 
© j 2 3 4 5 Se 


Ha egiGe:. 3. .Prmopabi laity cof day lost message as a 
function of the number of receivers. 


ZS 
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